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Why Do Competency Assessments? 

In addition to meeting federal regulations and accreditation 
standards, a competency assessment program can help a labora¬ 
tory reach other goals. Some of these goals are not required by 
any regulations but can help staff understand the importance of 
competency assessment and can help the staff work together bet¬ 
ter as a team. These goals include: 

1. Assure staff and management (and the public) that 
competency exists and is documented. 

2. Provide continuing education (CE) to employees, 

3. Provide objeaive performance feedback to employees. 

4. Help introduce new policies and procedures and review 
existing ones. 

The federal r^ulations fe)r competency assessment as stated in 
the Clinical Laboratory Improvement Amendments of 1988 (CLLA 
’88) (enaaed on February 28,1992,^ amended on January 19, 
1993,^ and revised on Oaober 1,2004^) can be accessed online at 
http://www.phppo.cdc.gov/clia/docs/42cfr493^004.htm. 

Althou^ it is important to be able to demonstrate to assessors 
and site surveyors that your laboratory staff is competent, that 
occurs only every 2 or 3 years. It is more important to continually 
assure each staff member that they can trust their peers to b^in or 
complete laboratory procedures that a staff member may be as- 
sign«l: Staff morale and productivity is negatively impaaed 'when 
this trust does not exist. Identification of competence gaps and 
their immediate correaion can reinstate this trust and improve 
morale. It is also important for laboratory managers, physidans, 
and all customers to be able to rely on this 24x7x365 competence. 

What Are the Competency Regulations 
and Who is Responsible? 

The laboratory directors responsibilities indude ensuring 
proper education, experience, and training of all personnel and 
ensuring that polides and procedures are established to monitor 


ongoing competency.^ Part b8 of Section 1451 states that the 
technical supervisor is responsible fon 

“evaluating thc^mpctency of all testing personnel and as¬ 
suring that the staff maintain their competency to perform test 
procedures and report test results prompdy, accurately, and pro- 
fidendy. The procedures for evaluation of the competency of the 
staff must include, but are not limited to¬ 
ll) Direct observation of routine patient test performance, 
including patient preparation, if applicable, specimen 
handling, proofing and testing; 

(ii) Monitoring the recording and reporting of test results; 

(iii) Review of intermediate test results or worksheets, quality 
control records, profidency testing results, and preventive 
maintenance records; 

(iv) Direct observation of performance of instrument 
maintenance and funaion checks; 

(v) Assessment of test performance through testing previously 
anal}wl spedmens (repeat testing), internal blind testing 
samples or external proficiency testing samples; and 

(vi) Assessment of problem solving skills;”^ 

The next responsibility states that the performance of indi¬ 
viduals responsible for moderate and high complexity testing 
must be evaluated and documented at least semiannually during 
the first year the individual tests patient spedmens and at least 
annually thereafter unless test methodology or instmmencation 
changes, in which case, prior to reporting patient rest results, die 
individual’s performance must be reevaluated to indude the use 
of the new test methodology or instrumentation.^ A summary 
and analysis of,competency assessments should be included in 
these performance appraisals. 

In spite of numerous changes to the CLLA ’88, the rules on 
competency assessment have not changed since first published in 
1992—and they are the same for moderate complexity and high 
complexity testing. What has changed is the enforcement of the 
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rules. Many accrediting organizations, such as AABB, JCAHO, 
CAP, and COLA, have gained “deemed status” indicating their 
requirements are at least as stringent as the CLIA *88 
regulations. Accrediting agencies may have additional compe¬ 
tency requirements. No matter whidi agency accredits your lab¬ 
oratory, it is difficult to avoid the inevitable question: “Where 
are your competency assessment records?” Accreditors are look¬ 
ing for evidence of an ongoing program, not a single snapshot of 
the competenq'' of a laboratory’s staff. 

Devefoping a Plan That incorporates All 6 
Components 

After reviewing the regulations, each section of the labora¬ 
tory should determine how it will incorporate eacli component 
into its competency assessment program. Remember that many 
of the aspects of your quality system may also qualify as compe¬ 
tency assessment. It may be beneficial to make a 2-columned 
table with the 6 competency assessment components in the left 
column. Each laboratory section can write in the right column 
how it plans to assess of the components. Think of each 
component as a different method of assessing competency, then 
look at the various procedures in the laboratory and determine 
which method would work best to evaluate the competency of 
the staff who perform each tasL For example, phlebotomy and 
some “manual” procedures are best assessed by direct observation 
[component (i)]. The second component (monitoring the record¬ 
ing and reporting of test results) is probably already being done as 
part of the laboratory’s quality assurance program. One can sim¬ 
ply state how each staff members ability to record and report test 
results is assessed and documented at least once per year. 

Assessment of the third cornponent (review of intermediate 
test results or worksheets, quality control records, proficiency 
testing results, and preventive maintenance records) is similar. 
These records and results are most likely being reviewed (or 
should be), again, as part of your quality system. The important 
aspect of a competency assessment program is that each staff 
member s ability to perform these tasks (ie, perform intermediate 
steps of procedures, complete worksheets, perform and record 
quality control and proficiency testing, and complete preventa¬ 
tive maintenance records) should be assessed and documented at 
least once each year. 

The fourth component is direct observation of instrument 
maintenance and function checks. Each staff member should be 
observed performing at least 1 instrument maintenance or func¬ 
tion check during a given year. The “direct observation” compo¬ 
nents (i and iv) are best and most objectively accomplished with 
the help of checklists. Any staff member can jeview the proce¬ 
dure to be assessed and list the key steps that should be observed 
in order to assess competency. Direa observation checklists need 
not be lengthy or decked but should indude “vulnerable” steps 
where, historically, errors have been made in the procedure. The 
checklist should include a conclusion (ie, a statement of whether 
or not the staff member was competent and what was done if 
not). 

A great deal of competency can be assessed through the lab¬ 
oratory’s proficiency testing program [component (v)] - espe¬ 
cially if proficiency samples are ro tated among all staff who 
perform each procedure and “leftover” specimens are repeated by 
other staff (AFTER results have been submitted!). The use of 
previously analyzed specimens (repeat testing) and internal blind 
testing samples can also be used to accorriplish this component 
of the competency assessment program. Note the use of the 
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word “or” in the Federal Register’s wording in this component 
[as opposed ro the word “and” in component (iii)]; it is not nec¬ 
essary CO incorporate all 3 of these methods in your program. 

Component (vi), assessrtient of problem solving skills, 
should not turn into a “stump the tech” exercise. Many of the 
tasb that laboratory staff members perform every day involve 
problem solving and these are what should be assessed. It is im¬ 
portant to determine that each employee can recognize problems 
and resolve them or refer them to the appropriate individual. 
There are several ways this can be done: 

L Refer to your problem log (every laboratory should have 
one). You can copy an item from the log, indicate that the problem 
was adequately solved and/or appropriatdy referred to someone else, 
and file this in each person’s competency assessment record. Exam¬ 
ples include instrument malfiincdon, QC out of range, and speci¬ 
men appropriateness. The responsibility of finding and cop)ing a 
problem-solving item should be delegated to each employee. 

OR 

2, All employees can document some problem-solving inci¬ 
dent that they have encountered during the year. Employees 
should write down the problem and the steps they took to re¬ 
solve the problem. Examples of incidents include phlebotomy 
problems (unable to obtain sample, patient refused), specimen 
problems (inadequite amount, improper identification, 
hemolyzed), customer called with a question, and discrepancies 
with previous results. The supervisor (or des^ee) should docu¬ 
ment that the problem was appropriately handled and file this 
documentation in the employee’s competency assessment record. 

OR, 

3. A staff member can create a problem situation (such as 
any of the items listed in 1 or 2 a.bove). All employees should 
write down the steps they would follow to resolve the problem. 
The supervisor (or designee) should document that the problem 
was appropriately handled and file this documentation in each 
employees competency assessment record. 

Employees should all be informed of the level of problem 
solving that is expected of them. If this-was not done during 
new-employee orientation, it should be done as soon as possi- 
ble—pcrhaps during each employee’s annual performance ap¬ 
praisal. For example, all employees are expected to detect and 
report problems Aac apply to their job responsibilities; some are 
expected to detect and investigate problems; others to detect, 
investigate and at least begin solving the problem; others are ex¬ 
pected to detect, investigate, and solve the problem. In all in¬ 
stances, employees need to be able to document the nature of 
the problem and what they did as follow-up. 

Implementing a Plan 

Once a competencty assessment program has been estab¬ 
lished, members of the laboratory staff should be encouraged to 
develop and maintain one of the components of the program. 
Dependirig on their individual skills and interests, one may be 
interested in creating checklists for direct observations, another 
may prepare samples for repeat testing, and another may create a 
system for the assessment of problem-solving skills. The mainte¬ 
nance of a viable competency assessment program can be a 
team-building exercise within the laboratory. 

Contingency plans should be established stating how a staff 
member who does not pass a competency assessment would be 
brought back to the “competent” status. In general, if a compe¬ 
tency “failure” occurs, the staff member should not perform that 
procedure until corrective action steps have been taken and it is 
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later documented that the employee is competent. The 
employees supervisor should determine the necessary corrective 
action steps and monitor their completion. These steps can 
range from reviewing the procedure manual to performing addi¬ 
tional test procedures to panial or complete re-training. 

Focused CE that is direaed at correcting misconceptions 
and lack of consistency is key to maintaining staflF competence. 

At the same time, reduced numbers of FTEs and shrinking CE 
budgets call for creative ways to provide CE for staff. Time is well 
spent and focused when staff members continue to learn about 
procedures they perform. Exercises that encourage staff members 
to study the procedure manual, become more consistent with 
other staff members, and understand the theory of the procedure 
contribute to productivity and fewer errors. The time spent com¬ 
pleting competency exercises should be recorded as CE that 
counts toward the kboratorys required annual CE. The person 
who prepares each assessment exercise should determine the 
amount of CE time to be granted. Generally, a maximum of 0.5 
hour CE should be granted per excrdsc. More than that works 
against staff productivity and may indicate that exercises are not 
focusing on specific problem-prone portions of procedures. 

The results of competency ass^ment exercises should be 
included in each employees annual performance appraisal and 
rolled into the total quality system. Emplo)^ees receive positive 
feedback for all exercises completed correedy (hopefiilly, the vast 
majority) and also receive specific information on things they 
need to correct or improve. This objective data makes perform¬ 
ance appraisals easier for management and more meanir^lful to 
employees. Other appraisal information can be gathered simulta¬ 
neously: Are assignments completed on time? Has the employee 
volunteered to prepare any of the exercises? Can the employee 
find inforntation in procedure manuals? Dees the employee ask 
questions when appropriate? 

Compet^cy assessment cxerckes can also be used to intro¬ 
duce new polides and procedures and to review existing ones. The 
CLIA regulations state that, prior to reporting out results, it 
should be documented that new employees (or employees being 
trained in a new area or on a new instrument or procedure) are 
competent to perform the procedure for which they are responsi¬ 
ble and that performance must be assessed at least semiannually 
during die firet year.^ This second assessment should occur some¬ 
time within a calendar year (Refrain from stating that it must be 
done at % months”; you will be urmecessarily constraining your¬ 
self) All laboratories have some procedures that do not change. 
They should be reviewed periodically—^perhaps a few each year. 
For effidency, only assess problem-prone parts of these procedures 
to assure that everyone is still performing them correedy. 

Testing Personnel 

Although it was first thought that the term “testing person¬ 
nel” (the term used in the Federal Register) referred only to 
those who actually perform laboratory tests, doser examination 
of the document reveals an explanation of the term. “Testing 
personnd” refers to anyone involved in any 1 of 3 phases: prean- 
alytic, analytic, and postanalytic—^think of it a)s “vein to brain.” 
This indudes all staff who collea and process specimens, those 
who perform test procedures as well those who report test results 
(via hard copies, a computer, over the telephone or in person). 

What about physidans? Some laboratories include patholo¬ 
gists in their competency assessment program; some hospitals and 
dinics include physidans (and others) who perform provider- 
performed microscopy (PPM) and other testing in the labora¬ 
tory s program. On the other hand, the medical staffs 


credentialing process c^ be used to document the competency of 
physicians. Any of these methods meets the CLIA or JCAHO 
requirement for competency assessment.^’^ 

Summary 

An excellent resource on this subjea was published in 2004 
by CLSL*® I would also highly recommend an artide published 
in 2004 by Sharp and Elder.*^ It is an extensive discussion of 
competency assessment in general, providing specific examples 
for implementing it in the clinical microbiology laboratory. The 
examples are easily transponable to other areas of the laboratory. 
Another excellent artide by Tiehen*^ addresses competency as¬ 
sessment in the laboratory. Both artides contain sample forms 
for documenting assessments and many helpful references. There 
are also several competency assessment packages available for 
purchase. They can be found by conducting an Internet search 
using words such as “laboratory competency assessment.” 

Competency assessment does not have to consume a large 
amount of time, efforti or money. An overall laboratory policy 
should be in place that states the components and time intervals 
of the program. Each seaion of the laboratory should have a 
competency assessment procedure and an annual plan that stat« 
how each component will be accomplished. All checklists and 
forms used to record competency assessments should indude an 
evaluation statement that indicates whether or not the staff 
member was deemed competent. A summary of eadi employee’s 
competency assessment should be induded in their annud per¬ 
formance appraisal. As long as the laboratory maintains a record 
of what was done each year, individual records can be discarded 
after 2 years, like other quality control records—unless your lab- 
oratorys accrediting agency states otherwise. 

TTie main goal of a competency assessment program should 
be to effidendy assess and document the competency of the lab¬ 
oratory staff. This reassures staff, management, acoediting agen¬ 
cies and the public of the competence of individuals who 
provide laboratory results that guide the healthmaintenance, 
diagnosis and treatment for those within the health care system. 
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